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SU3-0m>aZATI0N  ClilTERIA  XilD  OPEIiAnONS  RifaKAIiCH* 

Roland  N.  NcKoan 

First  of  aU  I  should  like  to  thank  Dr.  McCloskej  and  ths  others  who 
have  an*anged  this  opportunity  for  me  to  speak  to  you.  In  introducing  mj 
subject,  I  won't  spend  much  tljse  trying  to  deifine  Operations  Research. 
sure  that  is  unnecessary  in  ths  24th  lecture  of  this  series.  I  think  of 
Operations  Research  as  sioply  the  use  of  scientific  method  to  help  us  choose 
asKffig  alternative  means  (including  newly  devised  means)  to  our  ends.  These 
"laeans''  may  be  alternative  motions,  factory  layoxits,  operational  procedures, 
objects  of  expenditure,  allocations  of  a  budget  among  those  objects  of 
expenditure,  and  so  on. 

Now  in  this  process  of  choosing  among  alternative  means  to  our  ends, 
it  is  pretty  obvious  that  we  need  to  scan  the  ends  thesis  elves  with  a  critical 
eye.  This  is  a  thesis  that  is  euphasised  a  great  deal  by  philosophers  and 
theologians.  They  remind  us  frequently  that  our  industrial  economy  and 
scientific  developments  may  be  extremely  efficient  in  achieving  cexdAin  ends 
but  that  these  ends  may  be  the  "wrong"  ones  —  ends  that  are  selected  almost 
unconsciously  or  at  least  without  sufficient  critical  thought,  fhllosophers 
stress  that  we  must  keep  reviewing  and  questioning  the  pattern  of  ends 
implicit  in  our  behavior. 

A  homely  Illustration  that  is  often  cited  is  that  of  a  football  player 
making  a  brilliant  90-yard  run  to  the  wrong  goal.  Ha  may  make  a  series  of 
marvelous  sub-optimisations  and  perfonn  some  highly  efficient  footwork,  but 

5 

This  address  simply  elaborates  some  of  the  points  made  by  C.  J.  Hitch,  in 
"Sub-optimization  in  Operations  ProbleBs",  Journal  of  the  Operations 
Research  Society  of  America.  May,  1953,  pp-  37-99»  I  am  indebted  also  to 
W.  Capron,  G,  Cooper,  and  J,  Hirshleifer  of  The  RAiND  Corporation. 
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since  he  has  been  careless  in  selecting  his  goal,  the  total  performance 
somehow  doesn*t  add  up  to  an  efficient  one. 

Frank  Knight,  a  well-knc*m  ecorKmist  at  the  Universitj  of  (Chicago, 
often  emphaaiiied  the  importance  of  ends,  and  the  danger  of  neglecting  them, 
in  our  notions  about  efficiency  or  oconoogr.  ilfficiency  Just  doesn’t  mean 
anything  except  in  t  rms  of  values  or  ends  or  objectives.  When  we  calk  about 
the  efficiency  of  a  steam  engine,  we  are  talking  about  useful  output  in 
relation  to  input.  If  we  drop  the  worxi  "useful",  the  term  Wficiency" 
loses  all  sensible  meaning:  the  law  of  the  eonaervation  of  energy  tells  us 
that  all  inputs  became  outputs  in  one  form  or  another  so  that  without  the 
notion  of  useful  output,  efficioncy  is  always  100  per  cent.  Hence,  we  have 
to  watch  our  step  in  defining  useful  output.  The  steam  engine  may  be 
relatively  inefficient  in  getting  usable  energy  out  of  fuel,  yet  relatively 
efficient  in  zaaking  profits  for  a  particular  eetabllshment.  In  brief,  we 
have  to  keep  otr  value- jud^ents  or  objectives  constantly  in  mind. 

Of  course,  the  concept  of  ends  or  objectives  is  not  just  a  simple 
listing  of  several  desirable  events  or  desirable  outcomes.  Probably  the  only 
sensible  way  we  can  visualize  ends  or  objectives  is  as  a  preference  surface 
or  indifference  surface  relating  a  group’s  welfare,  a  firm’s  profit,  or  an 
individual’s  utility  to  various  combinations  of  goods  and  events.  For  this 
reason,  I  will  usxially  substitute  for  the  term  "ends"  or  "objectives"  such 
terms  as  "utility  function",  "profit  function",  or  "welfare  function". 

I  have  just  been  ei»phaslxd.ng  the  importance  of  ends  or  utility  fuinctions 
in  connection  wiUi  choosing  among  alternative  courses  of  action.  Criteria 
in  operations  research  are  important  in  much  the  laiae  way.  Criteria  are  in 
fact  the  practical  counterparts  of,  or  substitutes  for,  the  functions  that 
we  would  like  to  mriinilze  in  choosing  among  alternative  coursea  of  action. 
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In  coaparing  alternative  poilciea  or  operations »  one  would  like  to  project. 

If  it  were  possible,  the  total  anount  of  utilitj,  profits,  or  welfare  under 
each  of  the  various  alternative  policies*  Then  one  would  pick  the  policy 
that  yielded  the  most  utility,  the  most  profits,  or  the  sost  welfare  (depend¬ 
ing  upon  whether  the  "chooser"  was  an  individual,  a  firm,  or  a  government, 
respectively).  In  real  problems,  however,  we  have  to  look  at  some  prozdnate 
criterion  which  serves,  we  hope,  to  represent  or  reflect  what  would  be 
happening  to  utility,  profits,  or  welfare.  Hence,  criteria  —  in  other  words, 
what  we  look  at  in  order  to  distinguish  better  from  worse  policies  —  are  not 
actuajJy  the  uoility  or  profit  functions  that  we  would  like  to  maxinize,  but 
are  pr^^rlmata  indicator*. 

Let  me  illustrate  this  distinction  with  an  exaa^ple.  Suppose  an  indos- 
trial-machinery  firm  wanted  to  compare  alternative  methods  of  delivering 
parts  to  customers.  Its  researchers  niight  adopt  any  one  of  a  number  of 
possibilities  as  a  criterion  to  indicate  the  preferred  delivery  system.  To 
mention  a  few  of  these  possibilities,  the  criterion  might  be  expected 

profits,  if  they  could  be  projected.  Or,  in  lieu  of  this,  it  might  bo 
maximxan  revenues  for  a  given  cost  or  minimum  cost  of  generating  a  given 
volume  of  revenue.  It  might  be  maximum  volune  of  deliveries  (in  a  specified 
time  period)  for  a  given  cost,  or  minimxjm  cost  of  achieving  a  specifiod  type 
and  number  of  deliveries.  Thus,  it  wouldn^t  always  be  accurate  to  say  that 
the  actual  criterion  was  the  maximization  of  the  profit  function,  thou^ 
ideally  this  would  be  the  proper  crdterion.  TTio  most  accurate  way  to  use  the 
term,  I  think,  is  simply  the  way  the  dlctionarj'  uses  it:  a  criterion  means 
some  rule  or  teat  by  means  of  which  we  try  to  select  the  preferred  situation 
or  optimun  course  of  action.  To  repeat,  a  criterion  doesn’t  usually  mean,  in 
practice,  the  profit  function  or  the  utility  function,  or  that  magnitude 
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which  we  would  in  fact  like  to  aarlBlae.  It  ia  generally  some  ecaproMise, 
Bome  prcTiBate  indicator  that  ia  intended  t<  lead  lia  toward  the  nazlaiaation 
of  whatever  we  would  x^ally  like  to  aaxiaize.  To  return  to  the  dictionary 
definition,  criteria  are  aiaply  rules  or  testa  by  neana  of  which  we  select 
preferred  polieie:. 

Now  the  decisive  importance  of  criteria-selection.  Just  like  the 
importance  of  our  choice  of  ends  in  general,  ought  to  go  without  saying, 
let  there  is  a  great  danger  of  forgetting,  or  at  least  neglecting,  the 
significance  of  criteria-s  elect  ion.  If  ejctrsae  care  is  not  exercised  in 
this  part  of  the  task,  all  the  researcher^s  ingenuity  and  scientific  tools 
■ay  be  wasted  in  deriving  ri^it  answers  to  the  wrong  questions  —  which  are 
soaetlSMS  diaDstrlcally  wrong  answers  to  the  real  questions. 

Let  me  illustrate  how  wrong  a  decieion-oaker  can  be  if  he  adopts  an 
erroneous  criterion  with  an  example  that  you  might  say  cosms  from  nnmicipal 
government.  I  heard  of  a  motorcycle  policeman  once  who  patrolled  a  little 
stretch  of  road  outside  Chicago.  It  was  a  speed  trap,  and  one  motorist  kept 
getting  cau^t  every  few  days  by  this  cop.  He  got  fed  up  with  it,  and  had 
his  car  souped  up  so  that  it  would  do  120  miles  an  hour.  Sure  enough,  the 
next  day  the  cop  started  chasing  him.  As  he  began  to  close  up  on  the  speeder, 
the  motorist  suddenly  stepped  on  the  accelerator  and  disappeared.  In  the 
next  scene,  a  number  of  people  were  gathered  around  a  tree  at  the  side  of  the 
road,  inspecting  a  smashed  motorcycle,  and  trying  to  help  the  unconscious 
policanan.  They  finally  revived  him  and  asked,  "Wiat  happened?"  The  cop 
looked  around  and  then  answered,  "I  can*t  understand  it.  I  was  Just  about 
to  catch  that  speeder  and  all  of  a  sudden  my  motorcycle  stopped.  I  got  off 
to  see  what  was  the  matter  and  that’s  the  last  thing  I  remauber." 

Now  t'"e  criterion  on  which  he  based  his  choice  among  altematire  actions 

was  evidently  the  rate  of  change  in  the  gap  separating  the  two  vehicles,  or. 
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we  Might  eay,  the  ratio  of  the  autcaobile^s  speed  to  the  Motorcycle’s  speed. 

It  WM  a  wrong  criterion,  and  it  led  to  an  incorrect  course  of  action. 

But,  in  all  seriousness,  the  selection  of  appropriate  criteria  is  a 
crucial  phase  of  any  piece  of  operations  research.  ITiia  phase  Mgr  not  in¬ 
volve  the  use  of  scientific  method  —  it  nuy  not  be  an  exciting  endeavor  — 
but  it  a  part  of  the  operations  researcher’s  task.  I  realise  that 
scientific  analysis  is  supposed  to  be  relatively  independent  of  general  ralue- 
Jud^nents  or  objectives.  In  econcmice,  we  often  analyze  the  consequences  of 
altemabire  policiee,  and  then  say,  ’’The  voters  smst  choose  aaon^  these 
alternatives  in  the  light  of  their  own  value  Jud^^ients."  Or  maybe,  "If 
your  objectives  are  thus  and  such,  you  should  adopt  policy  A,  but  if  your 
objectives  are  so  and  so,  you  should  adopt  policy  D.”  In  consosers’  reasarch, 
also,  scientific  tools  are  used  to  describe  the  characteristics  of  alterna¬ 
tive  products,  but  the  researcher  does  not  presuns  to  set  down  the  consuBer's 
utility  function,  and  indicate  the  optimal  use  of  the  consumer’s  funds.  Even 
in  these  types  of  analysis,  of  course,  the  researcher  has  to  decide  which 
are  the  consequences  or  characteristics  in  which  the  consumer  or  voter  is 
interested.  But  in  moet  operations  research,  an  attempt  is  made  to  distinguiah 
better  from  worse  policies,  or  to  pick  out  the  optimal  coarse  of  action.  In 
this  typo  of  work,  while  the  custoowr  can  help  the  researcher  by  describing 
his  general  objectives,  the  researcher  usually  must  and  should  select  the 
proximate  criterion.  To  repeat,  this  is  a  part  of  his  task.  Nobody  is  going 
to  hand  appropriate  criteria  to  him  on  a  platter. 

C.  J.  Hitch  has  sunmed  up  much  of  the  above  as  follows;  ■The  validity 
and  therefore  the  usefulness  of  operations  research  depend  upon  the  skill 
with  which  projects  are  designed  and  particularly  upon  the  shrewdness  with 
which  criteria  .  .  .  are  selected.  The  criterion  problem  has  been  relatively 
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neglected  in  operations  research  literature,  and  has  apparently  iiauallj 
been  •solved*  In  practice  hy  assxaiing  the  first  plausible  payoff  function 
which  springs  to  aind;  or  if  several  spring  to  mind,  by  trying  all  and  coa- 
prosd.siag  (or  letting  a  coonander  coopronise)  among  the  results  of  alterna¬ 
tive  computations.  The  problem  is  much  too  important  for  such  casual 
treatment.  Calculating  quantitative  solutions  using  the  wrong  criteria  is 
equivalent  to  answering  the  wrong  questions.  Unless  operations  research 
derei^ops  methods  of  evaluating  criteria  and  choosing  good  ones,  its  quanti¬ 
tative  methods  may  prove  worse  than  useless  to  its  clients  in  its  new  appli- 
cations  in  government  and  industry.”  Thus,  what  I  have  been  trying  to  say 
is  bf  no  means  original,  but  in  mj  opinion  it  is  worth  considerable 
repetition. 

So  far  1  have  just  been  discussing  the  importance  of  criteria-selection 
in  general  terms.  Its  importance  is  brought  out  in  the  paper  by  Hitch,  from 
which  the  above  quotation  was  taken,  partly  by  means  of  specific  examples  of 
operations  reseeu'ch,  and  partly  by  means  of  a  look  at  the  nature  of  sub¬ 
optimisation.  I  will  attempt  to  elaborate  a  little  upon  the  last  point  — 
the  r.ature  of  the  optimizations  that  operations  x*esearch  can  provide. 

One  of  the  facts  of  life  that  makes  criteria-selection  so  difficult  is 
that  we  always  deal  with  incomplete  optimisation  and  sub-optimiiation.  It 
will  make  for  greater  clarity,  I  think,  if  these  two  concepts  are  distinguished. 
Incomplete  optimization  will  be  taken  up  first. 

Pull  optimization  would  require  the  simultaneous  consideration  of  all 

possible  allocations  of  one*s  resources  —  that  is,  all  possible  alternatives 

and  all  possible  allocations  of  one's  resources  among  those  alternatives. 

It  would  require  consideration  of  the  possible  impacts  of  all  exogenous 
- 

C.  J.  Hitch,  op.  cit.,  p.  87. 
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ev*nt8  —  that  is,  all  events  not  under  the  optiniiaer*3  control  —  and 
expectations  about  their  occurience.  Finally,  it  would  require  the 
fflaximizatlon  of  the  utility  function  of  the  optimitor  (e.g.,  an  individual, 
the  managers  of  a  firm,  or  the  deci8lon-«akers  in  a  government)  subject  to 
certain  initial  constradnts . 

Now  any  piece  of  oj)erations  research  falls  short  of  this  requlre*ont 
in  all  three  respects.  In  other  words,  we  are  always  dealing  with  incomplete 
optijaization.  The  reasons  that  any  piece  of  operations  research  falls  short 
iU'e  probably  obvious,  but  let  me  go  over  them  briefly.  First  of  all,  such 
research  considers  only  a  few  of  the  possible  alternatives  and  usually  only 
a  few  adlocations  oi  resources  among  these  alternatives  in  an  at, tempt  to 
select  an  optimi*  policy.  For  example,  suppose  we  return  to  the  industrial- 
machinery  firm  that  is  trying  to  compare  alternative  methods  of  delivering 
parts  to  its  customers.  The  company  officials  or  researchurs  are  likely  to 
consider  only  a  partial  list  of  alternatives.  Assume  for  a  moment  that  they 
compare  the  results  of  using  railroad  shipments  with  the  consequences  of 
owning  their  own  fleet  of  trucks.  Obviously,  if  they  ignore  a  third  method  — 
e.g.,  the  possibility  of  using  air  freight  —  they  may  not  reach  the  best 
answer.  At  first  glance,  the  solution  may  appear  to  be  simple:  Just  make 
sure  that  all  alternatives  which  are  close  substitutes  are  considered.  The 
difficulty  comos  about  because  of  the  fact  that  alternatives  are  not  always 
obvious  substitutes.  They  are  often  dissimilar  in  physical  appearance  and 
often  differ  in  their  specific  function.  Indeed,  to  turn  immediately  to  the 
extreme  case,  all  of  the  various  things  which  a  firm  or  individual  Ixiys,  or 
might  buy,  are  alternative  objects  of  expenditure  which  may  contribute  to  the 
firE*3  or  individual's  general  objective,  even  though  their  specific  functions 
are  as  different  as  day  and  ni^iit.  Dookkeepers  and  overhead  cranes  —  pianos 
and  gumdrops  —  all  are  alternatives,  substitutable  in  varying  degrees, 
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co«p«ting  for  the  purcheelng  agent’s  check. 

Now  It  is  obrioualy  Impossible  to  consider  simultaneotuslj  the  whole 
range  of  alternatives.  Moreover,  it  is  surprisingly  easy  to  overlook  a 
crucial  course  of  action  which,  if  considered  explicitly,  changes  drastically 
the  preferred  allocation  of  funds  among  the  various  alternatives. 

The  second  reason  we  are  always  dealing  with  incasplete  optimisation  — 
the  first  being  that  wo  can’t  possibly  consider  all  of  the  relevant  alterna¬ 
tives  —  is  that  one  can  make  only  a  few  assumptions  about  events  other  than 
those  controlled  by  the  optimiser.  Let  me  turn,  once  again,  to  the  hypo¬ 
thetical  industrial-machinery  fir*  trying  to  compare  alternative  means  of 
delivering  parts  to  its  customers.  Now  some  action  not  explicitly  considered 
ffli^t  affect  revenues  or  costs  with  railroad  shipaents  differently  from  the 
way  it  would  affect  revenues  or  costs  with  the  firm’s  own  fleet  of  trxicks  or 
with  air  frelgtit.  For  instance,  management  mi^t  decide  to  relocate  the 
plant  or  build  some  additional  plants*  Operations  might  suddenly  expand  on 
the  West  Coast,  or  the  local  market  ml^t  bocsB.  Such  events  beyond  the 
control  of  the  optimizer  —  decisions  at  higher  administrative  levels,  or 
developments  outside  the  firm  —  can  turn  the  researcher’s  answers  upside 
down.  Yet,  even  if  he  could  quantify  ejq>ectations  about  such  occurrences, 
it  would  be  impossible  to  take  into  account  all  possible  auisumptlons  about 
these  contingencies.  Again,  it  simply  means  that  operations  research  can  be 
no  more  than  incomplete  optimization. 

A  third  reason,  a  very  important  one,  that  we  can  attempt  only  incomplete 
optimization,  is  that  we  must  inevitably  use  an  imperfect  criterion.  As 
stated  earlier,  what  one  would  like  to  examine,  under  the  alternative 
operations,  iu  the  individual’s  utility,  if  the  optisdzer  is  an  individual 
consumer  —  or  the  firm’s  stream  of  profits,  if  it  is  a  firm.  We  can’t  do 
that,  of  course.  iYoflt  maximization,  by  the  way,  is  not  much  simpler 
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conceptually  than  utility  Baximization.  We  often  aay  that  what  really  matters 

to  a  firm  is  the  maximization  of  profits,  but  this  doesn^t  make  sense  in  an 

uncertain  world.  If  the  managers  consider  sereral  alternative  courses  of 

action,  maybe  they  can  anticipate  the  amount  of  ejoected  profits  in  various 

future  periods  under  each  alternative  policy.  Maybe  they  can  ^say  sooething 

about  the  variance  associated  with  the  expected  amounts.  In  other  words, 

maybe  they  can  say  to  themselves,  "Under  Policy  1,  our  expected  profits  will 

bo  in  the  first  period,  I2  in  the  next  period,  and  so  on.  Under  Policy  2, 

our  ejqjected  profits  will  be  (less  than  I^)  in  the  first  period,  Yp  (greater 

than  X2)  in  the  second  period,  and  so  on.  Under  Policy  3»  our  expected 

profits  are  greater  in  every  period  than  they  would  be  under  the  other 

policies,  but  there  is  a  greater  risk,  on  the  other  hand,  of  suffering  huge 

losses."  What  does  it  mean  to  maximize  profits  under  those  circumstances? 

All  it  can  mean  is  the  maximization  of  sooe  function  of  the  profits  expected 

in  various  periods  and  with  various  "probabilities".  This  function  depends 

upon  management *8  attitude  toward  risk  and  toward  profits  now  versus  profits 

five  years  hence.  We  don^t  know  this  function  any  store  than  we  know  an 

individual’s  or  a  government’s  utility  function. 

£kit  even  if  we  had  a  clear  notion  of  these  functions,  we  would  bavo  to 

settle  for  a  more  manageable,  albeit  a  less  appropriate,  criterion  instead 

of  looking  at  the  ultimate  imp>act  on  profits  or  utility  or  social  welfare. 

For  example,  as  the  offcials  in  our  hypothetical  firm  look  at  vardous  delivery 

systems,  can  they  really  translate  the  results  under  each  delivery  system 

into  effects  on  expected  sales,  expected  revenues,  expected  costs,  and, 

- 

See  A.  Alchian,  "Uncertainty,  Evolution,  and  Economic  Theory",  The  Journal 
of  Political  Kcononcy.  XSTIIl  (.June,  1950),  211-21,  or  S.  Enke,  "On  Maximizing 
Profits",  American  Economic  Review,  ILI  (Se{)teinber,  1951),  566-78.  This 
same  question  will  haraas  tlie  researcher  in  the  selection  of  the  "best" 
stream  of  costs,  gains,  profits,  utility,  welfare,  or  anything  else. 
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ulti*at*ly,  expected  profita?  Probably  not  —  at  leaat  with  any  confidanoa. 
So  they  settle  for  aoBiething  a  little  leas  appropriate  —  but  aoaething  they 
can  handle.  They  may  try,  for  example,  to  select  the  delivery  ayatein  that 
adnimizea  the  coats  of  achieving,  say,  4S-hour  delivery  service.  They  may 
try  to  select  the  method  that  mii^ijiu.zes  the  cost  of  delivering  parts,  regard¬ 
less  of  the  t^-product  effects  on  the  cost  of  delivering  other  items. 
Inevitably,  the  criterion  will  be  imperfect*  It  will  not  reflect  the  full 
range  of  effects  on  revenues,  costs,  and  total  profits.  So,  for  still  a 
third  reason,  operations  research  can  yield  no  more  than  incomplete  optisd- 
zationa. 

Thus,  the  methods  of  science  will  not  maidcally  or  auitonatlcally  reveal 
optimal  choices.  It  is  manifestly  impossible  to  demonstrate  that  incomplete 
optimization,  which  is  what  we  always  do,  will  ^  >teneral  lead  toward  the 
maximization  of  whatever  we  would  like  to  maximize.  Some  incomplete  optiid- 
zations  are  better  than  others;  some  may  give  worse  results  than  flipping 
coins.  It  will  always  be  necessary  to  use  great  care  and  good  Jud^ent  in 
picking  out  the  partial  optimizations  that  look  promising  and  to  sot  up 
appropriate  cirteria  in  terms  of  which  to  Judge  the  alternative  policies  or 
courses  of  action. 

I  turn  now  to  a  special  kind  of  incomplete  optimization  which  has  bean 
termed  "sub-optimization”.  An  esaontial  aspect  of  governmental  or  business 
operations  is  that  decision-making  is  decentralized  in  varying  degrees. 

Thus,  different  administrative  levels  allocate  the  rosourcea  at  their  dis¬ 
posal  among  the  uses  under  their  supervision.  The  government  provides  one 
of  the  best  illustrations.  At  relatively  high  levels  the  Federal  budget  is 
allocated  among  Departments,  such  as  Interior,  Defense,  and  Agriculture; 
among  the  independent  agencies;  and  among  broad  programs.  The  allocations  of 
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funds  within  Ospartsients  snd  progrsins,  among  different  projects,  and  taongst 
different  operations  within  each  project,  are  accompliahed  by  aAalnistratore 
at  "lower  levels"  —  in  other  words,  by  different  people  who  face  narrower 
problems • 

In  business  this  is  true,  too.  In  large  corporations,  authority  has  to 
be  delegated.  It  is  impossible  for  top  managesMnt  to  make  all  the  decisions 
and  optimise  over  the  whole  list  of  alternative  operations  or  courses  of 
action  simultaneously.  So  the  corporation  is  divided  into  divisions  or 
departments.  The  broad  decisions  are  made  at  the  top  level,  but  each  depart¬ 
ment  and  division  must  choose  among  narrower  alternatives,  and  so  on  down 
the  line  to  foremen  and  lower-level  aciministra'.ors  who  must  choose  among 
alternative  schedules  of  operations,  employees,  motions,  and  so  on. 

Even  an  individual  may  handle  his  affairs  in  this  way.  rie  may  first 
allocate  his  income  or  budget  among  the  big  categories,  such  as  food, 
clothing,  and  housing.  He  may  then  delegate  to  himaei_f  in  another  capacity, 
so  to  speak,  the  task  of  selecting  the  individual  suits,  pairs  of  shoes,  and 
cuts  of  meat  that  fall  under  these  broad  headings.  He  may  adliere  for  the  most 
j>art  to  the  original  allocation  asiong  the  broad  budget  categories.  In  other 
words,  he  may  allocate  his  income  among  these  categories  at  a  "higher  level" 
and  then  perform  narrower  day-to-day  optimizations  at  a  "lower  level".  It 
would  be  impossible,  when  making  individual  purchases,  to  compare  them  with 
all  alternatives  and  re-examine  each  day  one’s  allocation  among  all  major 
objects  of  expenditure. 

This  "lower  level"  optimization  is  what  I  will  refer  to  here  by  the  term 
"sub-optimization".  In  other  worlds,  sub-optimization,  as  used  here,  means 
the  process  of  choosing  among  a  relatively  narrow  list  of  operations  or 
resource  allocations  by  an  administrative  level  other  than  the  hij^est. 
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Careful  select  Ion  of  criteria  in  oub-opti*iMtion  is  difficult,  and  it  is 
crucial.  For  unloas  the  criteria  are  selected  with  gi*eat  skill,  operations 
research  maj  increase  a  departinent^s  efficiency  in  terms  of  its  test,  yet 
decrease  the  firm’s  efficiency  in  terms  of  its  ability  to  make  profits. 

Since  our  research  always  pertains  to  sub-optimiaations,  this  complication 
in  criteria-eelection  is  always  present. 

One  reason  that  sub-optimizations  present  these  difficulties  is  that  it 
nay  be  computationally  impossible  for  department  heads  to  compare  the  alter- 
natirea  facing  them  in  terms  of  the  criterion  that  would  be  appropriate  for 
the  entire  firm  or  goTemsient.  As  the  firm  grows,  the  difficulties  of 
coordination  increase,  and  genuine  confusion  develops  about  objectives  at 
departjaental  and  lower  levels.  The  chances  of  adopting  inferior  criteria 
smltiply.  If  Uie  sales  department  fl^ts  to  marUiize  the  ratio  of  sales 
per  dollar  of  selling  expense,  or  the  production  department  tries  to  minimize 
cost  per  unit  of  output,  or  the  fonsman  tries  to  minimize  the  number  of 
"seconds"  or  "rejects"  per  month,  it  may  cause  the  firm  as  a  whole  to  sacri¬ 
fice  profits.  In  government,  where  it  is  usually  impossible  to  measure  the 
coxmterpart  of  a  firm’s  profits,  sub-optimization  criteria  can  get  still 
further  out  of  hJind.  The  criterion  of  an  office’s  efficiency  may  be  the 
number  of  licenses  granted  per  dollar  epent  or  tho  number  of  letters  written 
per  typist.  Certain  typos  of  equipment  may  be  selected  because  they  yield 
laximtin  expected  life  or  speed  per  piece  of  equipment  or  maximum  accomplish¬ 
ment  pwr  man  employed.  Such  criteria,  particularly  ratios,*  may  not  lead  to 
increased  efficiency  in  terms  of  what  the  government  really  wants  to  do. 

ftit  even  if  we  avoid  downright  errors  about  the  nature  of  appropriate 
criteria,  sub-optimization  poses  obstacles  to  other  aspects  of  criteria- 

selection. 

- 

For  a  more  thorough  discuseion  of  ratios’  shortcomings,  see  Hitch,  op.  cit. . 

p.  %• 
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In  ganeral  tarns,  Uie  approprisla  criterion  for  the  fim,  goremnent, 
or  individual  saans  to  ba  the  nAxlml xation  of  gains  ninus  costs  (not  the 
ratio  of  gains  to  costs).  Of  course,  this  statemaiit  doesn’t  raailj  tell  us 
much.  In  any  particular  piece  of  operational  analysis,  the  big  qnestioas 
still  resiain.  One  of  the  big  questions  is  what  should  in  fact  bo  counted  as 
the  costs  of  the  altematire  operations,  programs,  or  policies?  The  costs 
of  one  program  ought  to  measure  the  gains  that  might  have  been  obtained  by 
using  the  same  resources  in  other  ways.  In  brief,  costs  are  what  you  gire 
up  in  order  to  have  this  program,  for  instance,  the  costs  of  operating  yoxir 
own  fleet  of  trucks  are  whatever  you  have  to  give  up  in  order  to  do  so.  If 
you  have  to  buy  them,  the  coat  is  the  dollar  outlay  over  the  relevant  period 
(minus  salvage  value  at  the  end  of  the  period).  In  many  proposed  operations 
or  programs,  however,  large  portions  of  the  equipment  may  already  be  on  hand. 
If  an  item  that  would  be  used  in  an  operation  is  in  stock,  what  should  its 
cost  be?  Presumably  not  the  original  cost.  Iirfhat  is  relevant  at  this  point 
is  its  value  in  alternative  uses.  Suppose  the  hypothetical  firm  that  was 
comparing  alternative  methods  of  delivering  parts  had  seme  trucks  standing 
around.  What  would  be  the  cost  of  using  its  own  fleet  of  trucks  to  deliver 
parts?  If  the  only  alternative  use  of  the  trucks  on  hand  was  to  sell  them, 
tl.en  their  salvage  value  would  be  the  cost  that  should  be  charged  for  them 
in  costing  thj.3  particular  delivery  system.  If,  however,  they  could  be  used 
to  advantage  in  another  department,  their  value  in  this  alternative  use  might 
be  g. -eater  than  salvage  va^ue.  In  sub-optimizations,  it  la  easy  to  overlook 
the  werth  of  equipment,  personnel,  or  any  resources  in  other  depjartments. 
Actually,  this  is  not  usually  an  important  consideration  in  the  private  firm, 
for  free  markets  provide  so  many  yardsticks  to  help  guide  each  depkartmental 
'’sub-optimizer".  Ikit  it  may  be  an  important  consideration  in  government. 
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particularly  in  Lh*  costing  of  altarnatiro  lailitary  operations. 

3ub-optiaii»ation  —  the  fact  that  lower  a<ialnlstrative  lerels  set  about 
their  operational  analysis  noro  or  less  independently  —  aggravates  another 
problem  In  costing  any  operation.  ^This  caaparUBentalizatlon  of  decision¬ 
making  increases  our  tendency  to  ignore  the  indirect  effect  of  one  operation 
on  costs  of  other  operations.  Assxsse  that  the  delirery  department  wanted  to 
choose  the  cheapest  way  of  achieving  a  given  objective  (o.g.,  48-hour  delivery 
service  to  all  cuatoewrs).  They  might  consider  only  costs  ^  that  departjaent , 
yet  the  delivery  systems  might  have  various  impacts  on  the  costs  of  other 
operations.  The  use  of  its  own  trucks  might  decrease  production  costs  by 
permitting  more  flexibility  in  choosing  new  plant  locations,  or  the  method 
COTisidered  might  increase  costs  (o.g.,  for  transportation)  in  other  depart¬ 
ments.  For  example,  the  use  of  trucks  for  some  deliveries  or  some  pick-ups 
mi^t  necessitate  less-than-carload  shipments  of  other  items.  To  the  indivi¬ 
dual  department  in  charge  of  the  operations,  the  impacts  on  its  costs  are 
felt  directly  and  are  more  likely  to  be  considered  tha:i  costs  felt  by  other 
dep>artinent3 .  To  the  firm  as  a  whole,  of  course,  the  criterion  for  choosing 
among  operations  would  involve  the  not  impact  of  each  operation  on  totail  costs. 
Clearly  it  is  important  for  sub-optimiaing  a^ialnistratora  to  make  the  cost- 
aspect  of  their  criteria  consistent  with  the  cost-aspect  of  higher-level 
criteria. 

As  Hitch  pointed  out,  this  is  analogous  to  a  subject  that  is  frequently 
discussed  in  econcoica,  the  discrepancy  between  private  costa  and  social 
costs.  Thet  is,  the  difference  between  the  costs  to  the  individual  department 
and  the  costs  to  the  whole  firm  is  analogous  to  the  discrepancy  between  the 
costs  of  some  operation  to  a  Tim  and  the  costs  to  society.  One  of  the  tradi¬ 
tional  examples  is  the  discrepancy  between  the  cost  of  em  industrial  plant’s 
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U3e  of  soft  coal  as  felt  by  tha  firm,  on  the  one  hani,  and  as  felt  by  the 
entire  aconomy,  on  the  other.  The  coat  to  the  entire  group  includes  not 
only  the  costs  to  the  firm  but  also  the  costs  to  "innocent  bystanders"  — 
e.g.,  tha  increase  in  laundry  bills  and  possibly  in  doctors*  bills, 
nconomists  usually  say  that  resources  would  be  better  allocated  asiong  alter¬ 
native  uses  if  the  firm*s  criterion  and  our  overfall  criterion  could  be 
brought  into  closer  harmony  by  making  firms  feel  the  major  indirect  costs  of 
their  operations. 

So  much  for  the  analogy.  In  any  event,  it  seems  clear  that  sub- 
optiinlzations  within  firms  and  particularly  withii*  governments  often  neglect 
this  aspect  of  an  appropriate  criterion  —  tha  costs  imposed  on  other  opera¬ 
tions  that  are  not  being  considere  1  directly. 

last's  turn  to  the  ottier  general  aspect  of  appropriate  criteria  —  the 
gains  from  the  operations  being  considered.  Irfhat  should  be  included  in  the 
calculation  of  gains?  Often  in  operations  research  we  "set"  the  gains  — 
i.e.,  specify  a  fi_xed  objective  —  and  try  to  determine  the  chea;«3t  way  to 
achievf  those  particular  gains.  Now  this  is  by  no  means  the  ideal  criterion. 
Most  firms  wouldn*t  be  content  merely  to  discover  the  cheapest  way  to  achieve 
a  given  volimie  of  revenue.  Iionethe^ess,  this  sort  of  criterion  is  often 
satisfactory,  and  it  will  serve  hero  to  bring  out  the  problems  of  sub¬ 
optimization. 

Thie  first  problem  that  is  aggravated  by  sub— optimization  is  the  selection 
of  a  ser'isible  fiaei  objective.  It  is  lifficult,  and  dangerous,  to  narrow 
the  proximate  objective  down  to  a  single  variable.  TTie  hypothetical  firm 
that  I  have  used  to  illustrate  various  points  was  cciaparing  alternative 
methods  of  ie’.lvering  iiiacliine  parts.  If  their  operations  researcher  tried 
to  set  up  a  given  objective,  he  could  not  realty  use  such  a  goal  as  4S-hour 
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aerrice  to  all  cuatooMra*  In  addition  to  speed  of  delirery,  the  dop-artment 
would  bo  concerned  also  with  reliability  of  delirery  and  with  the  condition 
of  tho  parts  upon  arrival.  The  operations  researcher,  if  he  could  not  do 
bettor  than  choose  sooe  fixed  proxiaate  objective,  would  have  to  ask,  "What 
objective  makes  sense  from  the  firis*s  standpoint ,  in  view  of  the  probable 
effects  of  delivery  upon  sales,  revenue,  and  ultimately  profits?" 

Another  exsaple  may  illustrate  more  vividly  the  necessity  of  looking  at 
mox^  than  one  variable  and  of  being  careful  in  setting  up  a  given  Bulti- 
dimensional  goal.  Suppose  petroleim  coBpxanieo  were  interested  in  alternative 
ways  of  storing  petroleum  products.  They  might  ruri  a  aeries  of  exp)«rlment3 
to  conipAre  the  consequences  of  storing  products  in  various  ways.  Tliey  slight 
specify  an  objective  and  choose  the  storage  aetnod  that  minimised  the  cost 
of  achieving  that  objective.  But  what  kind  of  an  objective?  A  specified  gum 
content  after  two  months*  storage?  Or  after  six  months  storage?  Should 
the  objective  include  a  measure  of  sedimentation  or  color?  A  certain  ash 
content?  A  potroloiaa  exp>ert  could  reel  off  a  dozen  or  more  variables  which 
might  be  included  as  dimensions  in  the  specified  goa^ .  The  sub-optimizer 
has  to  do  his  utsiost  to  soiect  this  aspect  of  the  criterion  in  the  light  of 
higher- level  criteria  —  or,  in  other  words,  from  the  firm’s  rather  than  a 
narrower  ’/iewpoint. 

In  some  cases  like  the  above,  the  quantitative  answers  that  the  opera¬ 
tions  researcher  can  provide  may  be  only  "consumers  research",  pointing  out 
the  cheapest  ways  of  achieving  several  possible  objectives  or  8p)exling  out  the 
gains  (not  a  given  objective)  and  costs  of  the  alternative  policies.  This 
is  what  consumers  research  usually  does  for  the  consumer.  It  points  out  that 
TV  Set  No.  1  has  a  certain  p)attem  of  characteristics^  while  Sets  No.  2  and 
No.  3  have  certain  other  characteristics.  The  consusMr  then  makes  his  c»wn 


i^3«6 

-17 


selection.  Of  coxirse,  the  operstlons  researcher  can,  and  usuallj  should, 
offer  hie  reooBsendation  to  his  custoner.  But  the  researcher's  reconmenis- 
tioD  and  the  client's  ultiaate  decision  will  both  be  better  if  the  sain 
uncertainties  are  recognised.  And  if  neither  the  client  nor  the  ressa^  <sber 
can  pin  down  a  aniqfue  specified  objectiwe,  the  cheapest  wajr  to  achieve  an 
assiased  objective  oajr  be  an  answer  that  has  spurious  definiteness*  As  far 
as  definiteness  is  concerned,  our  sub-optisiiaations  are  alwajs  inconplete, 
regardless  of  our  ability  to  specify  a  unique  objective.  In  alnost  no  case 
does  operations  research  provide  "the"  ansuer;  it  is  always  a  little  like 
consuners'  research,  providing  quantitative  infomation  which  ssst  be 
supplnsented  by  the  exercise  of  Judgaent  in  order  to  yield  recoHendations. 

To  s\ai  up  this  last  point,  it  is  not  a  simple  natter  to  perceive  a 
measure  of  gains  for  lower  acfainistrative  levels  that  will  harmonize  nicely 
with  objectives  at  higher  levels.  The  necessity  of  sub-optimizing  helps  to 
fill  this  phase  of  criteria-selectioo  with  problesis. 

But  sub-optlsdsatioQ  still  further  ccmpounds  the  difficulties  of 
measuring  the  gains  from  alter-mtive  opsrations.  In  oeasurlng  gains  as  well 
as  costs,  we  need  to  take  into  account  the  indirect  lsq>act  on  operations  other 
than  the  ones  explicitly  being  coBq>ared.  The  operations  under  consideration 
may  provide  benefits  to  other  departments.  If  our  hypothetical  firm  delivered 
parts  with  its  own  fleet  of  trucks  rather  than  via  air  freight,  it  could 
presimuibly  use  the  sides  of  the  trucks  for  advertising.  These  gains  would 
occur  in  a  different  department.  They  might  conceivably  be  substantial. 

The  operations  researcher  would  have  to  take  the  fim's  rather  than  seme 
narrower  point  of  view,  and  attaiq)t  to  take  such  indirect  g*<ne  into  account. 
If  the  researcher  had  set  up  a  given  objective  and  was  trying  to  determine 
the  cheapest  means  of  achieving  it,  such  bonus  or  "external*  would 
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har*  to  be  eraluated  and  deducted  froa  the  coat  of  the  operation  that 
yielded  the  booua  gains. 

i^ln,  there  la  an  analogous  problaa  in  ecancad.cs  that  has  caused  a  good 
deal  of  discussion.  The  discrepancy  between  gains  to  a  departswnt  and  gains 
to  the  entire  fim  or  governsant  Is  analogous  to  the  discrepancy  between 
private  and  social  gains.  That  is,  the  gains  to  society  of  a  fim*s 

operation  (s.g.,  a  training  prograe  for  eachinists)  may  exceed  the  gains  to 
the  fin  itself.  This  analogy  senres  perhaps  to  re-eaiphaslBe  the  point  — 
that  in  any  sub-optisdsation,  the  operations  analyst  needs  to  audce  a  special 
effort  to  dieck  for  possible  gains  to  other  operations  as  a  result  of  the 
ones  ta»lsr  consideration. 

Bverythlng  that  I  have  said  can  be  axanaed  up  in  the  following  propo¬ 
sitions.  Crlteria-eelectien  is  an  inescapable  and  a  crucial  part  of  the 
operations  rseesrcfaer's  task.  The  fact  that  we  always  sub-optlslse  helps 
lure  us  toward  erroneous  criteria.  The  fact  that  we  sub-optlnlse  means  that 
we  Bust  always  keep  a  weather  aye  out  for  (1)  the  value  of  resources  if  they 
were  used  in  other  departaonts,  (2)  the  isqaet  of  any  operation  on  the  costs 
and  gains  from  other  (^Mratlons,  and  (3)  the  eonaistaocy  of  the  criterion 
(asbracing  the  aaasure  of  gains  and  ths  asaaura  of  costa)  with  tha  aim  of  tha 
flm  (or  geverrsMnt)  as  a  whols.  In  othar  words,  the  eub-optimiser  should 
adopt  for  hla  analysis  the  ssaw  bast  critarion  that  top-level  executivea 
could  adopt  If  thay  had  to  exsalne  that  partieular  p>roblsB. 

The  oo^tatibiUty  of  lower-level  with  higher-level  criteris  Is  psrticularly 
sii^iificant  in  snother  operstions  research  problsn.  In  sobs  situstions, 
operational  analysis  may  rsooonand  worm  extensive  use  of  decentralised  decis¬ 
ions  guided  by  prises.  Such  arrsngflBsnts  nay  be  bslpful  occasionally  within 
hugs  fims,  but  nors  fraquantly  within  institutions  or  govormwatal  units. 
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For  oocanple,  the  Oefenae  Dep&rtaent  is  using  stock  snd  industrial  funds  to 
otanage  numerous  activities  as  though  thej  were  private  aanufacturing  or 
retailing  establishments.  Instead  of  handing  out  clothing,  printing  ser¬ 
vices,  or  Military  Sea  Transport  Service  for  free  whenever  requisitioned, 
the  Navy  sells  these  items  to  various  military  units.  This  forces  the 
users,  in  making  their  decisions,  to  take  into  account  the  fact  that  these 
items  cost  sostething  —  i.e.,  that  they  have  alternative  uses. 

Now,  in  what  situations  will  this  arrangesMnt  function  effectively? 
Operations  research  could  presumably  help  answer  this  question.  It  is 
apparent,  however,  that  the  answer  hinges  on  the  ci*iterion  problem  in  sub¬ 
optimisations.  Wherever  this  axnrangement  induces  lower-level  sub-optisdsers 
to  adopt  criteria  that  harmonise  with  toj^level  criteria,  it  seemm  premising. 
If  the  prices  charged,  and  the  purchasing  power  allocated  among  the  users, 
are  such  as  to  make  criteria  more  nearly  compatible,  this  institutl<Mial 
change  would  probably  bring  about  genuine  economdee.  If  the  situation  or  the 
method  of  pricing  is  not  conducive  to  the  consistency  of  lower-level  criteria 
with  higher- level  aims,  then  othor  institutional  arrangements  are  likely  to 
be  superior.  For  instance,  if  GI's  buy  their  clothing  from  an  alloMance,  they 
will  be  induced  to  care  for  their  clothes  in  a  fashion  that  corresponds 
closely  with  the  alms  of  the  Defense  Depariatent.  On  the  other  hand,  if 
they  bou^t  their  rifles,  hand  grenades,  and  other  arms  from  the  same 
allowance,  they  slight  be  Induced  to  make  choices  that  haimonised  rather 
poorly  uith  top-level  objectives. 

Thus,  a  constant  awareness  of  higher-level  criteria  is  essential  to 
useful  lower- level  sub-optlsd.sation.  Oisoeromsnt  of  top-level  criteria  may 
pay  off  also  in  another  type  of  effort  that  is  closely  related  to  qperationa 
reseaz*ch.  We  hear  a  great  desu  about  "performance  bndgets”  thaee  days  — 
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partly  for  induatiy  though  chieflj  for  goTernaenta  and  Institutions.  Such 
budgets  would  not  present  nanagesMnt  trith  optiaisations  or  even  recosBenda- 
tioos;  they  would  susaarize  the  proposed  expenditures  on  major  functions  or 
obJectiTss  and  attssipt  to  trace  out  quantitatively  %«hat  those  outlays  would 
buy.  I  soBStiass  call  this  aggregative  consumers*  research.  But  it  is 
closely  akin  to  the  conventional  description  of  operations  research. 
Scientific  techniques  help  us  to  trace  out  the  quantitative  implications  of 
the  aaounts  spent  on  major  functions.  Also  ~  and  very  important  from  the 
standpoint  of  this  paper  —  the  criterion  problem  confronts  us  again.  Into 
what  major  functions  or  objectives  should  the  proposed  expenditures  be  split? 
Uhat  sort  of  quantitative  ij^)!! cations  —  i.e.,  performance  units  or  prograa 
units  —  would  be  aost  useful  to  C<xigress  or  top  management?  In  trying  to 
answer  these  questions,  one  miist  wrestle  with  the  criterion  problea:  %diat 
ou^t  to  count  as  gains  and  costs  under  the  alternative  programs?  In  a 
perfomance  budget,  the  dollar  asiounts  would  reflect  projected  costs;  the 
functional  breakdown  and  quantitative  indicators  would  provide  clues  to 
performance  or  gains.  Only  with  considerable  insist  into  higher- level 
criteria  can  helpful  quantitative  clues  and  functional  breakdoims  be  pro¬ 
vided. 

To  conclude  —  we  have  to  live  with  decision-making  by  sub-optimization. 
In  this  process,  careful  attention  to  criteria  —  the  tests  that  are  used  to 
pick  out  preferred  actions  —  is  imperative.  And  this  means  that  in  all  our 
research  —  whether  we  make  lawei*-level  sub-optiaizations,  do  hi^er-level 
consisaere*  research,  or  recommend  changes  in  the  institutional  arrangements 
for  sub-optimization  —  the  researcher  and  client  must  keep  probing  into 
hi^er-level  objectives  and  criteria. 


